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ABSTRACT 
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ata makes it dirncuit effort 

ienif icance of Norman's criticisms. In an e “° 
o explore this controversy we taught one group of 
ovice users the UNIX command language and another 
roup an English-based command language (JO ^ 

■he number of errors and calls tor 
Assistance were compared. The subdects inthis 
itudy were 22 high school women with ^ 

:xposure to ‘ e ^o r ^ ttia^ the NUIX group 
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calls for on-line assistance for f 'e u| IX group 
the first session were comparabl , on-line 

made over twice as many calls tor ^ 

assistance in the second session t he 

group. Our findings sugge harder f or novice 

UNIX command language may not be , f _ 

users to learn, it is probably more difficult for 

them to use. 

INTRODUCTION 

Although UNIX is an elegant and powerful 
operating system, it is embroiled in a controve y 

November 1981, 139-150], that the ^ ^e S enous 
weaknesses in the UNIX user interface. tor 

:r Pl ^t C0 ^iir e relat e ed° f tr 

has no experimental evidence to support his 
thesis'! Se main objective 

^^^^^0 Sethis controversy 
further . 


Many good things have been said about the 
ttwty oDerating system developed by the Bell 
Telephone Laboratories and deservedly so. It has 
a sleek system design that includes a hierarchical 
file structure that has become the norm for modern 
operating systems. UNIX also offers input and 
output redirection, and a powerful command 
language called the shell. These and other 
f eafurls of UNIX have led to its wide acceptance 
Ld to its present status as an operating system 

standard. 

Although Norman has criticized several 
aspects of the UNIX command language, our 

--srisrat .ssvssje 

evaluation • 

THE SAMPLE 
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fourteen to seventeen years. Each workshop 
consisted of subjects from a different age group. 
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science and mathematics. (Consult Table I.) 

Students with a background in computers were 
not allowed to register for the workshops. Thi 
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ensured a population of novice computer users. A 
novice computer user is defined as a subject with 
no formal exposure to computers or computer 
languages. The use of novice users differs 
slightly from Norman's focus on the casual user. 
A casual user is defined as an occasional user of 
computers. The decision to use novice users was 
made on the premise that novice users were more 
clearly defined and more readily available. 

THE HARDWARE ENVIRONMENT 

The hardware environment consisted of a DEC 
VAX 11/780 operating under the VMS operating 
system. All subjects used interactive CRT 
terminals that were connected to the VAX through a 
port contender. The terminals were located in a 
terminal room containing approximately 25 
terminals. Each student was stationed at her own 
terminal. 

THE SOFTWARE ENVIRONMENT 

We initially designed a computer literacy 
workshop for the WIES program _ and developed a 
series of laboratory exercises for the workshop 
participants . We determined a small subset of 
twelve commands that were needed to execute these 
exercises. Since the VAX was not running the UNIX 
operating system, the UNIX shell was not resident. 

A simulated UNIX shell that contained the subset 
of twelve commands was developed. This pseudo- 
shell intercepted UNIX shell commands from the 
user and generated the proper DCL (Digital Command 
language) commands needed for execution. For 
example, a "MV" command (which renames a file) 
would generate a DCL "RENAME" command. 

Since the focus of the investigation was to 
study command names, we wanted to isolate that 
effect from other possible influences. We felt 
that the entering of parameters on a command line 
was such an influence. In order to rename a file 
in the UNIX command language for example, two 
parameters are needed in a specific order; the 
original file name followed by the new file name. 
We felt that requiring the user to remember both 
the command names and their respective parameters 
would introduce an unnecessary variable to our 
study. The question of how command parameters 
arfect the user is a very important topic and 
should be addressed in its own right. 

However in the present study we tried to 
negate the effect of entering parameters by making 
the process interactive. In the experiment, after 
the user entered a command, specific parameters 
were individually requested. For example, in the 
renaming of a file the user was requested to enter 
the original file name and the new file name. 
This removed from the user the burden of 
remembering which commands required which 
parameters in what order. 

To facilitate the learning of the command 
language, an on-line assistance feature analogous 
to the UNIX "MAN" command was implemented. When 
this command was executed, a list of the commands 
and their respective functions was displayed on 


the user's screen. The screen was cleared before 
the next command was entered to prevent the use 
from being overly dependent on this list. 

A duplicate of this UNIX pseudo-shell with a 
different set of command names was also created. 
This second command language functioned exactly 
like the first except with different command 
names. The command names were actual English 
words that described the function of the command 
This second command language was called the NUIX 
command language. The two command name lists art 
given in Table 2. 

Along with these two pseudo-shells, a user 
monitor was also developed. This monitor recorded 
every command that was entered by the user and 
marked those that were in error. This gave us the 
facility to record user error rates and the number 
of calls to the on-line assistance command. 

THE WORKSHOPS 

There were three computer literacy workshops, 
Each workshop consisted of three sessions which 
were held on three successive Saturdays. 

During the morning of the first session, the 
students were introduced to the WIES program and 
to engineering in general. In the afternoon, the 
students were shown a film on computers and were 
given a brief introduction to computers and 
command languages. At this point, the students 
were randomly divided into two groups. Each group 
was then taught a different command language by a 
df^fnrent laboratory assistant. One group was 
taught the UNIX command language while the other 
group was taught the NUIX command language. These 
lectures were both about forty-five minutes long. 
All the students were instructed not to take 
notes. After the lecture, both groups were led 
into the terminal room where each student was 
seated at her own terminal near other members of 
her group. The intent was to separate the groups 
to prevent confusion. The instructor stood in 
front of the room and assigned a series of 
computer tasks to the students. These tasks 
included such activities as copying, renaming, 
comparing, and displaying files as well as all the 
other commands that were contained in both of the 
command languages. The students were not allowed 
to use any materials to assist them with their 
exercises. Whenever a lab assistant was 
approached by a student with a request for help, 
the assistant directed her to the on-line 
assistance instead of answering the question 
directly. This first terminal session lasted 
approximately an hour and served as an 
introduction to command language usage for the 
students. After this terminal session, the 
students were asked to rate their individual 

performance using their respective command 
language. 

The first activity of the second Saturday was 
another computer session. This session lasted 
approximately one half hour. After the terminal 
session the students were given a tour of the 
I.I.T. computer facilities and were involved in a 


discussion of 

session^ 11 "Sf student were again asked to rate 
their individual performance. 

The third morning started with tha 
The tmr _ , this session, the on 

terminal session. g cabled This was 

Une assistance commands wer ^disabled. # of 

done in order to students were asked 

their command The^stude^^ a 

to experiment i the students were 

additionally asked to«te t e ea conversatio n 
^ r a r ?S V :o“?ftw a a^ engineer ended the 
morning's schedule. The afternoon was occupie y 
various WIES activities. 

THE RESULTS 

The experimental framework was such 
subjects were compared under different conditions 

therefore an analy, ^ *£\he 

measures was used. All analyses subjec t's 

subject's error and help rates Q f 

error rate was computed ^dividing of 

total number of commands. 

Table 3 contains the means and standard 
deviations for group ^ror^and ^ 

error^rat” 6 for the MIX group dropped from 7.2 to 
XT The error rate for the UNIX group had a 
lower ^initia° r value of 3.8 and dropped only 
slightly. The help lls 
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found. However, a ^mf lean (F(l,22) = 

sessions was found at t e interaction 

12.70). We also found a signifies A 

between groups and sessions (( , etween NUIX 

significant difference m help rates betwe 

and UNIX in session two -s * a "ignif icance to 
comparing the means resulted m a sigmric 

the .01 level (t - 3.182). 

Table 4 contains only the group error rates 
for the third session because the on-line 
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show a significant difference. 

DISCUSSION AND CONCLUSIONS 

This experiment was designed to investigate 
the effect of command names on 
Recall of command names was tested 


without on-line ^w^Se^-uS 

UNIX group had a lower e^ on -line assistance 

group seemingly had a 
Urger erro? rate. This result however was not 
statistically significant. 

. Loin rate as an additional 
If weusejh h P gee that while both groups 

°L initial help rate, the NUIX group had 
significantly lower help rate in the second 
session. The UNIX group continued to need 
substantial amount of help. 

c fhese results seem counter-intuitive. 

We expected a command language based on English 
We expec better than the UNIX command 

words to hava fa * come up with several possible 
language. »e have ^ Qne possibility is 

tha f 311 the° n f ami liar nature of the English command 
f t b e NUIX command language may have 

““«? .“IcX.™. i» a» «...»• Another 

P • Vi i -i t-r ■; o that synonyms may have been 

related possibility NUIX commands. 

confused "FIND" and "SEEK" may have 

For example, the wo COIn mand " SEARCH" . In 

substituted for the nuia orobablv would 
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““.iblUM is tut subj.es. unfaaillar «itb 
SIS*.! Wbossds tphe b... -d. .or. typsb, 

. l..,.. NUIX commands. A tourtn 
£ o ss ibil ty h is that novices may associate new words 
ESS «« concepts they have 1 -rned more 
easily than attaching new meanings to already 
familiar words. 
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before the deadline for this paper, we will 
present these results later. 

Our findings show that novice users have less 
Of a reliance 8 on on-line assistance with an 

Fnelish-based command language than with the UNIX 
Englis Thic: is evident when we vie*» 

command language. This is evioe . 

?«; ”r l ”h£' £5 “ * significantly 

“ lit Bsa if "f.tS 
“itiS-^crs „«s b i*.. 8 nS.. “Tit 

because we studied novice users while Norman was 
concerned with casual users. Our findings co 
suggest that even though the UNIX command language 
magnet be harder for novice users to learn, 
probably more difficult for them to remember. 


Table 1_. 

Demographic Characteristics of NUIX and UNIX subjects. 




NUIX 


UNIX 


N 


11 


13 


Mean 

Age 

15.15 

(0.5)* 

15.4 

(0.9) 

Mean 

G.P.A. (4 point system) 

3.2 

(0.6) 

3.5 

(0.5) 

Mean 

Math G.P.A. 

3.3 

(0.4) 

3.5 

(0.5) 

Mean 

Science G.P.A. 

3.5 

(0.7) 

3.5 

(0.5) 


* Enclosed value is standard deviation. 


Table 2 . 

Command Names and Functions. 



Table 3 . 

Mean and Standard Deviation of Group Error and Help Rates 
for Sessions 1 and 2. 


Session 

1 


Session 

2 

Error Rate 

Help 

Rate 

Error Rate 

Help Rate 

7.2 (5.2)* 

31.7 

(10.8) 

3.6 (2.5) 

11.6 (9.5) 

3.8 (3.1) 

32.0 

(15.4) 

2.3 (2.5) 

26.9 (13.9) 


* Enclosed value is standard deviation. 


Table 4. 

Mean and Standard Deviation of Group Error Rate 
for Session 3. 


Error Rate 

10.1 (9.1)* 

19.4 (19.1) 


Enclosed value is standard deviation. 
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